Droplet Phenomenology and Mean Field in a Frustrated Disordered System 



J. Houdayer and 0. C. Martin 
Division de Physique Theorique, Institut de Physique Nucleaire, Universite Paris-Sud, F-91406 Orsay Cedex, France. 

(February 1, 2008) 



00 ■ 

on : 

ON . 
t-H . 

S3 ■ 
<• 

oo : 

(N ■ 



S3 

S3 
i 

C/3 



C3 



I 

S3 
O 

o 



> 

m 
oo 
O 
00 
On 



S3 
O 

o 



X 
S3 



The low lying excited states of the three-dimensional min- 
imum matching problem are studied numerically. The exci- 
tations' energies grow with their size and confirm the droplet 
picture. However, some low energy, infinite size excitations 
create multiple valleys in the energy landscape. These states 
violate the droplet scaling ansatz, and are consistent with 
mean field predictions. A similar picture may apply to spin 
glasses whereby the droplet picture describes the physics at 
small length scales, while mean field describes that at large 
length scales. 
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A most useful approach in the study of disordered 
systems is the replica method. It has been success- 
fully applied 0] to the Sherrington and Kirkpatrick (SK) 
model § of spin glasses, yielding exact results and reveal- 
ing remarkable properties such as multiplicity of nearly 
degenerate ground states, lack of self-averaging, and ul- 
trametricity. However it is not clear whether these "mean 
field" properties hold for more realistic spin glass models 
like the one of Edwards and Anderson || where finite 
dimensional effects may be dominant. To tackle systems 
in finite dimensions, a number of approaches based on 
scaling and the renormalization group have been pro- 
posed In these phenomenological pictures, it is 
assumed that there is a unique ground state (up to a 
global symmetry) and that excitation energies satisfy a 
scaling ansatz. For our purposes, the essential ingredient 
of this ansatz is that a "droplet" , defined as the low- 
est energy excitation of characteristic size L containing a 
given spin, is assumed to have an energy which scales as 
L e , with 6 > 0. Hereafter we refer to such approaches as 
the "droplet picture" . 

Although the "mean field" and droplet pictures are 
very different, they both agree that there are numerous 
local minima in the energy landscape separated by sig- 
nificant energy barriers. The corner-stone of disagree- 
ment between the two approaches concerns the energy 
of excitations whose size is comparable to that of the 
whole system. In the mean field picture, there are such 
system-size excitations whose excitation energies are fi- 
nite, i.e., do not grow with the system size. Thus there 
are many nearly degenerate ground states and the en- 
ergy landscape consists of numerous similar low energy 
valleys. On the contrary, in the droplet picture, the char- 
acteristic energy for such system-size excitations grows as 
a positive power of the size of the system. As a conse- 



quence, the probability of having such an excitation with 
an energy below a fixed value goes to zero as the sys- 
tem size grows. Thus the ground state is almost never 
nearly degenerate with another significantly different lo- 
cal minimum. Furthermore, from the point of view of the 
droplet scaling ansatz, the existence of many nearly de- 
generate ground states would lead to < 0, and yet, for 
the spin glass phase to exist at non-zero temperatures, 
droplet excitations must be suppressed, leading to 9 > 0. 

These points show that an unambiguous determination 
of the lowest energies of large scale excitations would help 
resolve the controversy over the relevance of the droplet 
and mean field pictures to finite dimensional spin glasses. 
Unfortunately, the main obstacle in the way of such a 
test is the computational complexity of spin glasses: just 
finding the ground state is AP-hard 0, and finding the 
excited states is at least as demanding computationally. 
We have thus chosen to investigate a different system: 
the three-dimensional minimum matching problem (see 
below). Although it is both frustrated and disordered, it 
is computationally more tractable than a spin glass. For 
this system we have devised a new algorithm which al- 
lows us to enumerate very efficiently all the states above 
the ground state in a systematic way. To our knowledge, 
this is the first time it is possible to explore unambigu- 
ously a non-trivial frustrated disordered model. With 
our computational tool and some analysis, we find that 
the droplets in this model have energies which grow with 
their size, justifying a droplet picture with a positive ex- 
ponent 8. However we also find that the thermodynamic 
limit is a bit singular. In particular, some "infinite" size 
droplets appear at low energies, creating an energy land- 
scape with many nearly degenerate valleys. Our three- 
dimensional model thus has a droplet like behavior at fi- 
nite length scales, but its energy landscape at large length 
scales is as predicted by mean field. 

The model - We consider a system arising in com- 
binatorial optimization: the minimum matching prob- 
lem (MMP) @. This choice is motivated by the fol- 
lowing properties: (i) the problem of finding ground 
states of two-dimensional spin glasses can be mapped to 
a MMP H (see |]] for recent developments); (ii) we are 
able to compute quickly and exactly the ground state 
and the excited states of the MMP for any realization of 
the disorder; (iii) a droplet picture can be constructed 
quite naturally; (iv) the replica approach has been used 
to solve a mean field approximation of the model . 

Consider N points (N even) and the set of "distances" 
between them. These distances define the instance, that 
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is the quenched disorder. A micro-state or configuration 
is any "matching" of the points, that is a dimerization, so 
that each and every point is paired with exactly one other 
point. The energy of a matching is defined as the sum 
of the distances between matched points. The MMP, as 
defined in combinatorial optimization, consists of finding 
the lowest energy matching. Because of the disorder, the 
system is frustrated: each point would like to be paired 
to its nearest neighbor, but in general this cannot be 
achieved for all points. In the statistical physics formu- 
lation, one sums over all micro-states, weighting them 
with the Boltzmann factor. One also takes the thermo- 
dynamic limit (N — > oo), and for that, one must specify 
the quenched disorder ensemble. 

In the Euclidean form of the MMP, one considers N 
points at random in a 3-dimensional volume. In order to 
avoid edge effects, we use a cube with periodic boundary 
conditions. The large N limit is taken at fixed density 
of points, and thus corresponds to the usual infinite vol- 
ume limit. (In these units, which we use hereafter, the 
volume is equal to N and the ground state energy is ex- 
tensive, i.e., proportional to N.) To tackle this model, 
it is useful to consider a mean field approximation of the 
problem; this has been done by Mezard and Parisi ]Tc| ] 
who applied replicas to a modified model where all cor- 
relations among distances between points were removed. 
Hereafter, we call this modified model the (independent) 
random-link MMP because all the "distances" between 
pairs of points are independent random variables. These 
individual distances are taken to be distributed as in the 
Euclidean model. 

In a parallel with spin glasses, one can consider the 
Euclidean MMP to be the analogue of the Edwards- 
Anderson model, incorporating frustration and disorder 
in a Euclidean space; similarly, the analogue of the SK (or 
better yet, the Viana-Bray O]) model is the random-link 
MMP. It is known that the random-link model provides 
an excellent approximation for the ground state energy 
density of the Euclidean MMP. (See M] for an overview 
of some of the associated properties of ground states.) 
Now we will see that it also enables one to understand 
the corresponding energy landscape. 

Excitations - A general matching differs from the 
ground state by replacing some of the bonds by others. 
One can organize those two sets of bonds into alternat- 
ing loops where every other bond in a loop belongs to 
the ground state matching, the others belonging to the 
excited state matching. (This follows from the fact that 
each point is matched to one and only one other point; 
see Figure |l| and |L3|.) Any excited state thus consists of 
alternating loops which are non-overlapping, i.e., which 
have no points in common. The total excitation energy 
is the sum of the energies of each loop. With this in- 
sight, the system can be viewed as an (interacting) gas 
of loops. Hereafter, we consider only excitation energies, 
i.e., all energies are measured relative to the ground state 




FIG. 1. Comparison of two matchings. One is in solid lines, 
the other is in dashed lines. Non intersecting alternating loops 
describe the difference of the two matchings. Here there are 
two loops, of sizes 4 and 6. 

energy. Also, we define the size of a loop as the number 
of bonds it has; the size £ of any loop is thus even and 
satisfies 4 < £ < N. 

Local density of states - At low enough tempera- 
tures, this gas of loops becomes very dilute, suggesting 
that "loop-loop" interactions may be neglected (recall 
that the loops cannot overlap). In this approximation, 
the thermodynamics of the gas may be computed from 
the local density of states associated with single loop 
excitations. Thus we have determined numerically the 
local density pi(E) of one- loop states of size £ and of 
energy E. To accomplish this, for each realization of 
the disorder, we generate all the single loops up to a 
maximum energy. Our algorithm does this in a system- 
atic way by successively increasing the length of different 
bonds and finding the new ground states. This increase 
in length has the effect of preventing the new ground 
states from containing certain bonds. The process can 
be organized into a tree search with a branch and bound 
so that all the states below a given energy are obtained. 
We then determine the number Afi(E) of loops of size £ 
with energy between E and E + AE. We have averaged 
Ni{E) over 10 3 to 10 4 randomly generated instances for 
N = 50, 100, 150, 200, and 250 points; this leads to the 
estimator pe(E) = (Afg)/NAE. Our data show that the 
different values of N lead to the same function, justifying 
the definition of pi(E) and indicating that our values of 
N are large enough for finite size effects to be negligible. 
For each £, we find that pe(E) is a smoothly increasing 
function of E with the property pe{0) ^ 0. This fact can 
be understood by considering the measure of the points 
leading to a loop of zero energy. (It should be clear that 
finite dimensional spin glasses also have this property be- 
cause the probability density of having a cluster of spins 
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TABLE I. Density of states at zero energy as a function of 
the loop size in the three dimensional Euclidean MMP. 
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4.520 
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30.2 
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23.5 


10 


0.205 


20.5 



in a null local field is non-zero.) 

Droplets — Fisher and Huse define droplets in the 
context of spin glasses; generalizing their definition to the 
matching problem is straightforward. For a given point, 
consider the set of all single loops of size £ (L < £ < 2L) 
passing through that point. Define the droplet of char- 
acteristic size L containing that point as the loop in the 
defined set with the lowest energy. When applied to the 
MMP, the droplet picture states that the typical energy 
of droplets of size L scales as L e , 9 > 0. Furthermore, the 
scaling ansatz j(| says that the probability distribution 
of the energy El of a droplet of size L behaves as 



P L (E L )=p(E L /L e )/L e 



(1) 



with p(0) ^ 0. A direct test of this scaling ansatz is 
beyond the possibilities of our numerics because large 
values of L would require too large computation times. 
Thus we have instead performed an indirect test of the 
scaling ansatz as follows. 

Our method is based on relating p(0) to the p^(0)'s. 
Since we are concerned with very low energies, exci- 
tations are rarefied; as in the dilute gas approach, we 
will assume that the excitations are independent. Using 
Equation |l|, we derive the probability distribution of the 
lowest energy droplet of size L in the whole system, and 
find that the mean of this distribution is L 1+e /Np(0). 
(For this, we assumed that the droplets were indepen- 
dent; we also used the property that the number of 
droplets of size L is N/L up to constant factors, each 
droplet containing O(L) points.) We can also calculate 
this mean using the p^(0)'s; setting the two expressions 
to be equal leads to the sum rule 



PL (0) + P L+2(0) ■■■+ P 2L-2{0) = P (0)/L 



1+6 



(2) 



(In the case of spin glasses, the exponent would be 3 + 9 
assuming that droplets of size L have 0(L 3 ) spins.) If 
the scaling with 9 > is valid, Equation || gives pi(0) = 
0(£- 2 ~ e ). In Table | we give the results for p e {0) and 
£ 2 pi (0) as a function of £ for the values of £ within reach 
of our computations. (Our data have statistical errors 
which prevent us from going to much larger values of £ in 
a meaningful way.) The positivity of 9 is confirmed by the 
decrease of these quantities with increasing £, giving good 
evidence that the droplet picture applies to the MMP. 

Breakdown of the droplet picture — Consider now the 
distribution P(£i,N) of the length £\ of the first excited 



0.4 



0.3 



0.2 



0.1 



0.0 



□ 
+ 

A 



n 





N 


= 50 


□ 


N 


= 100 





N 


= 150 


A 


N 


= 200 


+ 


N 


= 250 



, n<> a 



0.0 



1.0 



2.0 



3.0 



4.0 



5.0 



FIG. 2. Scaling function G{x) (see Equation^) for different 
values of N. 



state. This quantity is easy to extract numerically; fur- 
thermore, P(£i,N) is a probability distribution over £i, 
and a calculation similar to the one just discussed gives 

P(£i,N) = piMIY.tr Pi'®)- when N -> °°. P(ti,*0 
converges pointwise to a limiting distribution which falls 
off quickly with £\ ; the nature of this fall off is consistent 
with the droplet picture as we saw previously. However, 
we also find that anomalously large loops appear with fre- 
quency 0(\j \f~N\ These large loops have lengths which 
grow as s/N, and their distribution satisfies the following 
scaling law as N — > oo 



Prob{£ x = x) ~ G(x)/VN 



(3) 



with the scaling variable £\ — l\/yN. This scaling is 
illustrated in Figure |^; the finite x contributions at dif- 
ferent (large) values of N lead to the same curve G(x). 
(Note that the fixed size loops lead to a delta function 
contribution at x — 0.) This scaling is incompatible with 
the droplet picture as can be seen by considering the mo- 
ments of P(£i,N). If the exponent 9 existed, pe(0) (and 
thus P(£i,N)) would be 0(£^ 2 " 6 ). Then the moments 
(£i 1+s ) would be finite for S < 9 and would diverge as 
N — > oo for S > 9. However, from Equation |3|, the diver- 
gence sets in as soon as 6 > because of the contribution 
from the anomalously large loops. The conclusion is that 
although the droplet picture shows all signs of being cor- 
rect when one takes the limit N — > oo while keeping the 
scale fixed, it is not valid if one considers scales which 
grow with the system size! 

Mean field picture and energy landscapes - To shed 
light on these anomalously large loops, consider the mean 
field picture as obtained by using the properties of the 
random link MMP. For that model, we have repeated the 
calculations performed in the Euclidean case and have 
determined spectra of energies and the sizes of the corre- 
sponding excitations. (Although the random link model 
has been solved by the replica method, this kind of infor- 
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mation has not been obtained previously.) First of all, we 
find that all low lying excitations have sizes of 0{*jN). 
In particular, for the first excited state, we find that the 
large N scaling is given by Prob(£i = x) ~ Grl (%) , again 
with l\ — i\jyfN . The random link model excitations 
thus have the same \f~N scaling in size as the anoma- 
lous excitations in the Euclidean model, and in fact, the 
scaling functions G(x) and Grl (x) are qualitatively sim- 
ilar. Note that Grl(x) has no delta function peak at 
0, i.e., no contribution from finite size loops; this can 
be understood from the "geometry" of the random link 
model: its structure is locally that of a Cayley tree, and 
as N — > oo, finite size loops connecting near neighbors 
disappear. Second of all, we find the following scaling 
law 

(N RL (E))/AE~ R RL (E) (4) 

where E = E^/N and Mrl{E) is the number of loops 
of (rescaled) energy between E and E + AE; the scaling 
function Rrl increases like an exponential. 

These results show that the random link MMP has 
many low-energy large-scale excitations, the characteris- 
tic size of which is 0(V N) and the characteristic energy 
of which is 0(l/y/N). To obtain a mean field picture 
for the Euclidean model, we can say that the large scale 
excitations of the random link model "survive" in the 
Euclidean model; if we add the small size droplets to 
these large scale excitations, we generate valleys. (Note 
that essentially the same droplets make up the different 
valleys, so that the valleys are nearly identical in struc- 
ture.) If this picture is correct, we expect the statistics 
of the excitations associated with the bottom of the val- 
leys of the Euclidean model to be qualitatively similar 
to the statistics of the states in the random link model. 
To better see these "valley" states, we have studied the 
loops of size greater than C^/N (where C is a constant). 
With this restriction, we find that the scaling in size and 
energy of low energy excitations is very similar in the 
random link and Euclidean models. In particular, the 
Euclidean model satisfies Equation || with a scaling func- 
tion R which is close to Rrl- 

In view of the fact that there is no replica symmetry 
breaking in the MMP, it may seem surprising to have 
such a structured landscape; one would expect instead 
the droplet picture to be the whole story. But this is not 
the case, the droplet picture breaks down on the scales 
where the mean field picture predicts large scale excita- 
tions of low energy. Since these excitations involve only 
0(\/N) bonds, the valleys have an overlap which tends 
towards one in the N — > oo limit, and this is consistent 
with the absence of replica symmetry breaking. But the 
point is that these valleys differ by an infinite number of 
bonds in that limit, and that the droplet picture is valid 
only within a single valley. 

Let us speculate on how our results may extrapolate 
to the case of the Edwards- Anderson spin glass model. 



There may be two types of low energy excitations: the 
first given by the droplet picture and associated with 
fixed sizes, and the second given by the mean field pic- 
ture and associated with system-size excitations involv- 
ing O(N) spins. This second contribution is responsible 
for the valleys in the energy landscape. The bottom of 
the valleys can be thought of as states similar to those 
arising in the mean field picture, having statistics well 
described by that approach. In particular, the statistics 
of the bottom of those valleys may well obey a scaling 
law such as Equation || with E = EN 1 where 7 is a new 
exponent; the characteristic inter-level spacing of these 
valley energies is then 0(7V~ 7 ). Of course, the small size 
droplets give rise to energy levels with a characteristic 
inter-level spacing of 0(1/N). We expect the exponent 
7 to be given exactly by mean field. We are currently 
investigating this question. 
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